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outline consisting of 323 terms. Which provides a systematic set of 
construqts. for desqribing. all the elements (environment, goals, 
^resources, ' methodology, rl^sults, and utilization) th^t relate to the 
input,, process, and output of pT;ogram evaluation in the 
rehabilitation service system; and (2) an alphabetic thesaurus which 
includes all of the termg contained in the hierarchic ou^tline as well 
as terms that, refer a user to an accepted system term. Bbth the 
hierarchic outline and alphabetic thesaurus were developed in a 
manner that complements the existing Rehabilitation Service' 
Administration" s Research Information System Thesaurus. 
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PREFACE 

This~rn onograph t o th^ Rphahil itatinn S-prvices- ^^dm inistration '(RSA) hy thft 



""Wverslfy cff Wtscbnsrn T^eg^^^^ Rehabf Hta-t ion Res^^feb^lmmme :( 
represents the culmination of nearly six mofithfs of planning and actf^ity 
relevant to the development of a classification of program evaluation tech- 
nology and literature; it is ,the final report of the project.. ^The need for 
such a classification>was initially recognized by RSA and supplementary funds 
were awarded to the UW-RRRI to complete thi^s project because it complemented 
the UW-RRRPs Core area of research, "Improving Management Effectivenessi of 
Rehabilitation Agencies: Evaluation T'echniques and Effectiveness Measures;" 
.Whfle the UW-RRRI coordinated and directed this effort it did- not function 

o t^'-- "> ■. if 

unilaterally without technical and pragmatic input from others^. State Voca- 
tional Rehabilitation agency personnel, academic professionals and indeper^dent 
researchers in program evaluation, information scientists, as well as RSA^ 
officials were called upon repeatedly for advice and assistance. In addition 
a conference was held in Madison on July 16 and 17, 1975 for the purposes of 
developing the basic structure of the classification system. This conference i 
proved invaluable to the RRRI and appreciation is extended to the participants; 
Ed Acree, Terry Concur, John Muthard, Isabel Robinault, Claire Schultz, 
Judy Senkevitch, iLeRoy Spaniol , Robert Struthers, and Marvin" Wei linger. 

Since the ijiception of the piV-oject both the RRRI' s director, George N. Wright, 
and the Researcli Director, Ken Reagles, have served as consultants and a word 
of thanks i*s afforded to them. Finally, Brian McMahon, a doctoral student iri 
the University /of Wiscon^iin-Madison Rehabilitation Cc/unseling Psychology Pro- 
gram and my research assistant, receives my gratituyde for fiis Velentl ess effort. 



n 



in helping to compile, edit and alphabetize the list of de;5criptors . I can 
honestly say that without him, the project could never lhave been completed 
within the time frame allotted *to us. 
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• INTRODUCTION 

, / ■ 

The Purpose of"trTg'iri^rtt1i:HttDTr'Sy5tei^ 



/ 

/ 



The Rehabilitation Act of 1973 (P.L. 93-112) with its mandate to "measure 
and evaluate the impact of all programs authorized by this- Act" not only" 
provided a series of new and multiple requirements for state Vocational • 
Rehabilitation (VR) administrators, it also led to an increase in both the 
utilization of existing evaluation technology as well^as the development of 
new evaluation strategies. 

/ In the last two years, responses have been generated at the national and 

state level regarding the impact of rehabilitation programs upon the disabled 

population. These responses have included a variety of measurement .devices 

aimed at assessing some of the potential benefits attributable to the receipt 

of VR services. Yet, because of the myriad of conljiunication problems that 

exist in any large service organization, much duplication of effort results. 

'In addition, spme VR programs have established evaluation upits with the 

f 

intent of rigorously measuring program impact and effectiveness, while other 
V. programs have made little progress in this area, either because of insufficient 
resources or lack of technically trained manpower. . ^ 

VR agency administrators, academic professionails in program evaluation, 
independent researchers, and RSA officials have contended that both practi- 
tioners and researchers in VR progrant evaluation could function more effectively 
and efficiently if a classification system of program evaluation technology and 
literature existed. A classification system could' be used by a central clearing 
house to. catalog program evaluation technology and literature, making them 
'readily and economically accessible for retrieval. The efficient retrieval of 



ERIC 



6 



program eva1^J)^.i^|^^^i^ v^uld encourage its proper and prompt utilization 

In additibn, a classification system would^ provide for greater communication 

■ ■ '.. — - - ^ii^' . • , • ■ ' 

aniicmg rehabil itation^personnel , ultimately improving the exchange of ideas 

1. — -i i- ■ *~ ' r— -r^ ^rz ' . . ■ — ~' — ~— ; : ■ • ■ — — — — 



^ while preventing duplicatioji of research efforts. Moreover, with a systematic 
compilation and examination of technology presently available, knowledge gaps 
-could be easily identified, thereby encouraging new research while justifying 
. funding of the research. . 

With these potential benefits in mind the UW-RRRI developed the present 
classificjition system that includes a hierarchic outline and alphabetic the- 
sauru's. The hierarchic outline is a systematic set of constructs for describing 
all t|ie elements--environment, goals, resources, methodology, results, utili- 
zation—that relate to the input, process, and output of program evaluation in 
the rehabilitation service system. The alphabetic thesaurus includes all of 
the teV*ms contained in tl^e -hierarchic outline as well as terms that refer a 
iser to an accepted system term,. ^ term that exists in the hierarchic- outl ine. 



BQth the hierarchic outline ^and alphabetic thescjurus were developed in a manner 
tha£ complements the existing RSA Research Information System (RIS) Thesaurus 
so that the users of that system will have a limited amount of difficulty 
adjusting to this system. 

Like the RIS Thesaurus, t;he purpose of this system is to control the 
nuances of ekpr^sion relevant to indexing and retrieving information, tech- 
nology, 5ind literature-O^f iriterest to rehabil itation personnel and others 
concerned with program evaluation- Every effort was made to make it both com- 
prehensjv^' and potentially expandable. The independent terms were selected by 
taking account of the language habits of program evaluation personnel. 
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The Organization and Use of "this Classification Systm \ 

The term "Evaluation" presently exists in the RIS) Thesaurus ti no^r the 

brdader term Rese arch. Eval uation in that system encompasses some of \he com- 

^.^ . - . ^ ..... . . ....... . - - - ^ " .' ' ^ 

ponents of program evaluation, client evaluation and job evaluation (analysis). 
The system developed by the UW-RRRI is concerned only with program evaluation, 
and the descrip,tive' list of terms appearing in the hierarchic outline and 
alphabetic thesaurus conceptually fall under this rubric. Still, prog^ram 
evaluation is only one component of evaluation and it should^ be clear to the 
users of the system that omissions of client eva-luation and job analysis were 
intended. % 

In contrast to the RIS Thesaurus, t|ie hierarchic outline of terms pre- 
cedes the alphabetic thesaurus. This ordering was chosen for the purpose of 
promulgating the thesis that program evaluation is a process, rather than a 
discrete entity. It is a systematic, continuous process that provides infor- 
mation about the value or worthwhil eness of a program for the ultimate purpose 
of making decision?. Consequently, users of tFiis classification system-- 
authors, indexers, retrievers— need to conceptualize each document in program 
evaluation as having a role i'n providing information on. some component of this 
process. The ease with whiich documents can be classifn'ed and retrieved will 
be dependent upon the user's familiarity with the Outline. 

The alphabetic thesaurus is organized in a manner consistent with the RIS 
Thesaurus with one exception; related terms were not included. Because program 
evaluation is a process, rather than a series of Uniterm descriptors, and since 
the process is explicitly operational i zed in the hierarchic outline, a user 
should not need alternative terms for the purposes of classifying or retrieving 
a document, if the outline is used properly. If a user is interested in 
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related or alternative tern^s to a specific consulted term, those should be 
found by examining the terms in the hierarchic outline that exist on the same 



level and in the same section where the consulted term lies, 



The system terms in the alp.habetic thesaurus are accompanied by one to 

'three types of notes:, "Refer from," "Narrower terms," and "Broader terms." ' 

"Refer from" names those terms which were not accepted as system terms but do 

refer users to the term being consulted. "Narrower terms" are those descrip- 

tiv€ terms that appear one level below the consulted term in the hierarchic 

outline. Similarly, "Broader term'^ refers to the' descriptive term that is one 

level above the consulted term in thie^ hierarchic outline. The alphabetic the- 

saurus also has a section of "use 'terms" whiQh refer users to a term that is 

an accepted system term. The following example illustrates the aforementioned 

format. 

Agencies: 
Refer from: State agencies 

Narrower terms: Comnunity agencies. Federal agencies, L^iw 
enforcement agencies. Manpower agencies. 
Vocational rehabilitation agencies. Welfare 
agencies 

Broader term: Settings 

Agency relations: ^. 
Use: Interagency linkages • 

The alphabetic thesaurus gives users the terms in_the hierarchic outline 

and informs them of the terms to be used when classifying or retrieving a 

document. It is hoped that^the thesaurus, structured in this way, will allow 

for the retrieval of appropriate documents whert users a^^^^^estions like, "I 

want some information on benefit-cost st^udies idone on alcohol ic"^Dulations." 



The Development of the Classificatton System 

T^e hierarchic outline cons^t^ of 323 tj^rms. Most of tHese were setb^ted 
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by examining the titles of nearly 3,0G0 documents related to program evaluation. 

Others were suggested- by participants at a conference held in Madison, Wisconsin 

r ' ^ ■ m . ^ -^--^ '-^^ - 

.(July 1975) which was concerned with the development of a skeletal model of the 

present hierarchic outline. The alphabetic thesaurus was-completed After* the 

hierarchic outline had been finalized; broader terms and narrower terms followed 

logically from the outline. " . 

Unlike the RIS Thesaurus, this system was assembled without the aid of a 
computer. Thus no error detection programs were ri^n to locate orthographic or 
logical inconsistencies. — 

With any new project with wide dissemination there will be disagreement 
among users concerning the^ placement of certain terms in different parts of 
the hierarchic outljne. Too, terms have probably not been Included that some 
"users may feel are necessary. These should i)e brought to the attention of 
RSA's Office of Research and Demonstration as the classj/ication system will 
be revised frorti time to time and appropriate changes will be incorporated. 

While this thesaurus is an entity distinct from the RIS Thesaurus, con- 
ceivably it will be incorporated into this larger system' at some later point. " \ 



PROGRAM EVALUATrDN 



— ; Hierarchfc OutlTne 

E11V1 r onnienT*^"""^ 

A. Attitudes' 

1. Bias ^ / 

2. Commitment 

3. Evaluation fears 

a. Defenses . ^ 

b. Resistance 

4. Personnel attitudes ^ 

a. Employer attitudes 

b. Evaluator attitudes 

c. Evaluee attitudes. 

d. Management attitudes , ^ 

e. - Staff at'tilfudes - \ 

5. Political attitiudes 

a. Community attitudes 

b. Legislation 

B. Condition^ 

1. Barriers 

o a. 'Arohttectural barriers 

b. Delays 

c. intrusions • 

2. Econoinic indicators 

laborjrtarket conditions 
'b. ' Organised / work force 

c. Poverty - 

d. Stock market ' 

3. Incidence 

! Other service resources 

i a. Ancillary services 

b. Service duplication T 

5. Prevalence 

6. Relations 

a. Industrial relations 

b. Interagency linkages 

c. Interpersonal relations 

d. Public relations 

7. Values 

a. Ethical and legal constraints 

b. Policies 

C. Needs 

1. Community needs 

2. Evaluation needs 

a. Priorities 

b. Problem identification 

3. Interests 

4. Research needs 
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-Settings 

1. Agencies 
a. Community agencies 

Fpftpral agpncieS 

t. Law ejiforcement agencies 

* e. Vocational rehabilitation agencies 
f . Welfare agencies 

2. Facilities 

a. Centers 
1) Community centers 
.2) Management assessment centers 

3) Mental heal th -centers 

4) Multiservice ^enters 

b. Clinics 

c. Correctional facilities 

d. Halfway houses 

e. Hospitals 

f. Rehabilitation facilities 
1(1) Occupational training facilities 
V2) Sheltisred workshops 

g. Schools \j 

3. Geographical areas _ 

4. Services ^ 

a. Intervention processes 

1) Behavior modification 

2) Counseling 
. (a) Family counseling 

(b) Group counseling 

(c) Multiple counseling 

(d) Peer counseling 
• * (3) Hypnosis 

(4) Milieu therapy 

5) Occupational therapy 
6} Psychotherapy 

(7) Rehabilitation processes 

b. Programs 

(1) Compensatory programs 

(2) * Corrections 

(3) Oay care 

(4) Education 

(5) Foster care _ 

(6) Health care 

(a) Intensive care , 

(b) Medicare 

ic) Methadone maintenance 

(d) Post hospital services 

(e) Public health 

(7) Legal services 
(8} Post employment services 
(9) Psychological testing 
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(10) Recreation 

(11) 3ocia'l action programs 
. (12) Training 

la) In serviqe training 
(b) Job training 
» (g) Mobil ity training 
(d) On the job training 
' (e) Sensitivity training 
(13) Welfare programs 



A. Approach rationale 

B, Expectations 
-C. Gbal setting 
;..D. Mission 

€. Mdtivartion - 
. , F. Philosophy / 
III.v Resources " 

A. Finances 

1. Budget allocations 

2. Contracts 

3. ' Grants 

i; ' 4. Loans v ^ m 

B. ^ Information systems 
'"■]. /I, Bibliographies 

2. Classification systems: 



a. Definitions 

b. Thesaurus'^s 

3. I nfoysmat ton centers 
a . . , CI eari ng. houses 
, b. Goveirnnient Information' soi 

c. Other information sources 



&• Literature reviews 
6. /Management information sys.tems 
C. Materials 

1. Audiovisual aids 

2. Data processing equipment 

3. Pfiysical plant 

- 4. Telecommunications 
D>. Personnel 

, 1. Administrative personnel 
" a. Coordinators 

b. ^ Directors 

' c. " Supervisors 
2. Evaluative personnel 

a. Consul tants ' . 

h\ Data processing personnel 

c. E valuators 

d. . Investigators 

e. Pol icy analysts 

f . Researchers 



1 1 . Goal s 
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3. Service personnel 
a*; Aides ' 

/ > b. Counselors - 

c. Educators i;: 

d. Placement specialists ' 

e. Support staff 

E. .Target populations / 

1. Age groups 

a. Adults . ^ 
^ ' (1) Aged - 

(2) Older adults . * 

(3) . Young, adults - 

b. Youths , : 

(l) Adolescents , 
M2) Children 

(3) Infants " . 

2. ' Disadvantaged 

f 3. Dysfunctional persons i 
a- Addicts 

b. Alcoholics 

c. Developmental ly disabled 

d. Mentally ill 
. e. Offenders 

-f. Physically disabled* . / 

4. Ethnic groups 
\5. Military personnel 

'6. Severely disabled ^ . ' ' 

7, Students - ' . 

8. Unskilled workers * . 
IV. Methodology 

A, Analyses 

1- Qualitative analysis i 

a. Judgments ' - ^ 

rb. Narrative descriptions 
2. Statistical analysis 

a. Descriptive statistics _ 
^ h. Inferential statistics . ,v - / 

c. Multivariate statistics ^ 
V (1) Actuarial techniques * . 

' . V i/"^) Automatic interaction detector » 
(34 Factor analysis ' \ . 

(4) Multiple regression * ' ' 
' . d: Reliabil'ity - . ^ 

• ' e. Validity ^ , , TV ^ 

Data collection ^ 

Data banks* , \ ^ ^ ... 

a. Case files . ^ 
. ' b. Data tapes , , • > 

*SpecTfic categories of physica>ly disabled persons can be developed from' the 
narroweV terms li-sted under the system term "Disabl^.d" tn the' RIS Thesaurus . 



2. Data collection instruments 

a. Checklists - 

b. Forms 

c. Questionnaires 

d. Tests * 
V (1) Achievement tests 

' (2) Aptitude tests 

(3) Intelligence tests . 

(4) Interest tests 

(5) Personality tests 

(6) Situational tests ^ * 

3. Data collection strategies 

a. Incentives 

b. Mail surveys 

c. Observations ' 
. (1) Direct observations 

(2) Participant observations 

(3) Unobtrusive observations 
&. Personal interviews 

e. Telephone interviews 

4. Sampling techniques 

a. Matching 

b. Probability sampling 

c. Random sampl i'ng 

d. Stratified random sampling^ 
Designs . ° . . 

1. Cost analysis ^ ^ 

2. * Experimental designs" 

3. ^.^Molj experimental designs 

a. ^ Case studies 

b. Correctional studies 

c. Ti^ldVstudies 

. d. Fellow up studies 
^e. Longitudinal studies 

f . Simulations & - V 

4. Quasi experimental designs 

5. Systems analysis 

a. Critical incidents technique 

b. Management by objectives 
* c. Operations research 

d. Path analysis t 

e. Program evaluation review technique. 

f. Program planning and budgeting system 
Evaluation criteria 

1. Evaluation outcomes 

2. Evaluation standards " * ^ 
, a. Case difficulty ' - 

b. Caseload size 
^ c. Expectancy ratios ' - 
d. j^orms ■ ^ * 
B;. ^Staff to/clie.nt ratios 

'^ ■ * ■ 

15- 
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Measurement 

1. Client assessment methods 

2. Scaling 

a. . Attitude s;ca1 ing 

b. Empirical scaling 

c. GoaV attainment scaling 

d. Multidimensi6naV- scaling 

e. Semantic' differential 
F. Record keeping procedures 
Results I . 

A- Documents 

1. Abstracts 

2. Books 

V 3- Handbooks " ' 

'4. Journal articles 

5. Monographs 

6. Reports 
B- Indicators 

1. j: Effectiveness indicators 

a^. Client satisfaction 

b. Counselor effectiveness 

c. Goal attainment 

2. Efficiency indicators 

a. Cost benefit ratids 

b. Effort 

"c. Ev|fluation length 

d. Sec^vice length 

3. Perforipance indicators 

a, Ab)|lit1es 

b. Acfiievement 

c • Job -performance ^ 

d. Ratings 

e. Recidivism rates 

f. Skill acquisition f 

g. Vocational adjustment 

4. Social indicators 

C. Indices 

1. Benefits 

2. Earnings 
3\ Employment 

a. 'Attrition 

b. Job placemenlt 
Tenure 

4, Rehabilitation gain V 

5. Status 

a. Acceptance 

b, - Closure 

t. Employability 
• d. Intake 
, - , e- Referral 

y f. Socipecorioniic status 

D. * interpretation ' . ^ 
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VI. 'Utilization 
* A. Change 

• I. , Atti tilde change 
2^ Policjyj chafige 

3. Pfogrlam change 
. ^ a. Reirsonnel reas. 

b. Relocation^ 

4. Service change * 

B. .Communications 

1. Dissemination • 

2. . Feedback 

C. Decision making - 

1. Program continuation 

2. Program implementation 
3/ Program justification • 

a. Accreditation 

b. Certification 
4. Recommendations V, 

D. Demonstrat'^'on 

E. Evaluation adequacy 

F. Impl icati ohs 

1. PolitihaTization 

2. Predic|tion 

3. Social reform / 

G. Replication studies 



Alphabetic Thesaurus 



Abilities * * 

Refer from; ^ducability 
Broader term: Performance 
. V indicators 

/Abstracts 

Broader term: Documents 

•Academic achievement 
Use: Achievement 

Academic accreditation 
Use: Accreditation 

Acceptance 
Broader term: Status 

Accountabil ity 
Use: Program justification 

Accreditation 
Refer from: Academic accreditation, 
Facility accreditation' 
Broader term: Program justification 

\ ' i- ' ' 

Achievement ^ • , 

. Refer from: Academ'ic' achievement, 

Vocational achievement^^ 

\ Broader term: Performance 

indicators 

Achievement tests * . 
Broader term: Tests 

Action programs ^ ^ . 

Use: Social action programs 

Activities 
Use: Methodology 

Acts . ' , 

Use: Legislation 

Act:uarial techniques 
Broader term:- Multivariate 
statistics 

Adaptation 
Use: Change 



... 



Addicts 
Broader term: Dysfupctiohal 
persQhs 

Adequacy of evaluatioi^ 
Use: Evaluation adequacy ' 

Adjustment 
Use: Change 

Administrative personnel 
Narrower terms; Coordinators, 
n^i ' Directors, 
? ?| Supervisors; 
Birpader term: Personnel 

Adolescents > 
Broader t^l?m: Youi^hs' . 

Advertising 
Use: Public relations 



Adult education 
Use: Education 



Adults 

Narrower terms: A|ed, Older 
ap.ults. Young 
. a^Uil ts 
Broader term: Age* groups 

Advice 
Use:- Recommendations 

Advisers 
Use: Consultants . 

AFDC 

Use: Welfare program 

Aftercar'e 
Use: Health care 

Age groups - ^ 

Narrower terms: Adults, Youths 
Broader term: Target populations 

Aged « 
Ref er^ from: Elderly 
Broader term: Adults 
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Agencies . ^ 
Refer frpm:/ ^tate" agencies ' 
Narrower t^^: poirmunity agencies, 
Federal agencies, 
Law enforcement 
agencies. Manpower 
agencies; Voca- 
tional rehaMli tac- 
tion agencies. 
Welfare agencies 
Brc^deif' tjferm: Settings 

Agency relations 
- U^e:^, inter agency linkages 

Aictfes . 

,^f&f from: Case aides 
Jroaider term: Service personnel 

♦,'■,/ 

AlfcOhOl ics 
iBrpad^r term: Dysfunctional persons 



nputee^ 
'Use: Physically disabled 

nalyses , 
Refer from: Comparisgns 
Narrower ternfis: Qualitative analy- 
sis, Statistical 
analysis 
Broailer term: Methodology 

Ar|billary services 
broader term: Other service 
resQurces 

Arti poverty programs 
[Use:i Social action programs 

:iety 

Ise: Evaluation fears 



Aphasics 

i lise: Physically disabled 

Appairati 
Uae: Materials 

ApproWh rationale 
Reffer from: Rationale of approach 
Broader term: Goals 
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; Approaches . 
Use; tjesigns 

A ' 
. Appropriations 
^ Usfe: Finances 

Aptitude tests 
Broader term: Tests 

Architectural barriers 
Broadir term : Barr i er s 

Asians • " 

Use: Ethnic groups 

Asser;tiveness training 
Use: I Counseling 

AssessiT»ent 
Us6: Client assessment methods 

Attitude change 
Broader term: Change 

Attitude scaling ^ 
Broader term: Scaling 

Attitudes 
Refer from: Dispositions, Negative 
attitudes. Temperament 
Narrower terms: Bias, Commitment, 
Evaluation fears. 
Personnel attitudes, 
Pol itical attitude's 
Broader term: Environment 

Attrition 

• Refer from: Turnover 
Broader term: Employment . 

Audiovisual aids 
Refer from: Charts, Films, Graphs, 
Histograms, Illustra- 
tions, Tables, Video- 
tapes, Visual aids 
Broader term: Materials 

Auditors ) 
Use: Investiga^Jtors 

Audits 
Use: Cost analysis 
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Automatic interaction detector 
Broader term: Multivariate 
statistics . 

Barriers 

Refer from: Obstacles, Problems 
Narrower terms: Architectural 

barriers, Delays, 
Intrusions 
Broader term: Conditions 

Basel ine data 
* Use: Nor^ms 

Behavior modification 
Refer from: Conditioning, Contin- 
• gency contracting, 
, Desensitization, Ex- 
tinction, Instrumental 
conditioning. Modeling, 
Operant conditioning. 
Shaping, Token Economy 
Broader term: Intervention 
processes 

Benefits 
Broader term: Indices 

Bias 

Refer from: Objectivity, Open- 
mi ndedness. Prejudice, 
Racisin, Rosenthal 
effect 

Broader term: Attitudes 

Bibl iographies 
Refer from: References 
Broader term: Information systems 

Blacks 
Use: Ethnic groups 

Blind 

Use: Physically disabled 
Books 

Broader term: Documents 

Budget allocations 
Refer from: Capital expenditures 
Broader term: Finances 
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Capital expenditures 
Use: Budget allocations 

Cardiacs * ' - 

Use: Physically disabled. 

Case aides 
Use: Aides ; * .* 

Case difficulty 
Broader term: EValuatibn standards 

Case files 
Broader term: Data banks 

Case management 
Use: Rehabilitation processes^ 

Case studies 
Broader term: Non-experimental , 
designs *\ ' 

Caseload size 
Broader term: Evaluation rpSmdards 

Casework 
Use: Rehabilitation processes 

Centers 

Narrower terms: Corrmunity centers. 
Management as^es^s- 
ment centers, 
* Mental health 

centers, Multi- 
service centers 

Broader term: Facilities 

Certification 
Refer from: Licenses 
Broader term: Program justification 

Change • 

■ Refer from: Adaptation, Adjustment, 
Conformance, Maladjust- 
ment, Modifications,'' 
Reform 

Narrower terms: Attitude change. 
Policy change. 
Program change. 
Service change 

Broader term: Utilization 



0 • , 



Charts 
Use: Audiovisual aids 



Checklists 
Broader .term: 



Data collection 
instruments 



Chicanos 
Use: Ethnic groups 

Child care 
Use: Day care 



Children- 
Broader termf Youth 



Si 



Chronically ill 
Use: Severely disabled 

Civil rights 
Use: Ethical and^gal constrairvEs 




Classificat 
' Refer 



systems 

Codes, Indexing, Nomen- 
clature, Taxonomy, 
, Typology 
Narrower terms: Definitions, 
Thesauruses 
Broader. term: Information systems 

Clearing houses • 
Broader term: Information centers 

\" 

pllient assessment methods 

^efer from: Assessment, Diagnostics 
Broader term: r^HH^rstrfenient 

CI ient satisfacti^pn 

lefer from: Satisfaction 
^roader term: EVfectiveness 
indicators 

Clinics 
Broader term: ' Facil>J:les 

Closure 

Broader term: Status 

Codes 

Jse: Classification systems 



Collections ' 
Use: Data collections 

College students' 
Use: Students 

Colleges 
Use: Schools 

Commitment 
Broader term: Attitudes 

Comnunications 
Refer from: Dialogue 
Narrower terms: Dissemination, 
Fieedback 

Broader term: Utilization 

Community action programs 

- Use: Social action programs 

Community agencies 
Broader term: Agencies 

Community attitudes 
Broader term: Political attitudes 

Community centers 
Broader term: Centers 

Conrmunity mental health centers 
Use: Mental health centers 

Cormiunity needs 
Broader term: Needs. 



Communit/ services 
. Use: Services 

Comparisons 
Use: Analyses 

Compensation 
Use: Earnings 



J 



Compensatory programs 
Broader term: Programs 

Comprehensive health care 
Use: Health care 
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Computers 

« Use: Data processing equipment . 

Conclusions 
Use: . Results • 

Conditioning 

Use: Behavior modification 

Conditions 

Refer. from: Situations 
' Narrower terms: Barriers « Economic 

indicators. Inci- 
dence, Other ser- 
vice resources , 
" - • Prevalence, Isola- 
tions, Values 
Broader /'term: Environment 

Confidentiality 
Use: Ethical aod legal constraints 

Conformance , 
Use: Change 

* 

Consequence^ 
Use: Implications 
« 

Consultants . , . , 
Refer from: Advisors, Consultation 
Broader term: Evaluative personnel 



Consultation 
Use: Consultants 

Context 
Use: Settings 



Contingency contracting 
Use: Behavior modification 

Contracts 
Broader tierm: Finances 

Cooperation 
U,se: Interagency linkage 

Cooperative programs ^ . 
Use: Interagency linkages 

Coordination 
Use: Interagency linkages 





ntal L 



indicators 



Coordinators 
Refer from: Organizers 
Broader term; AdministratiV/ 
personnel 

Correctional facilities 
Broader term: Facilitie 

Corrections 
Refer from: Delinquency^ prevention J 

, programs, parole^ ' 
Broader term: Programs 



Correlational studies 
^ Broader term: Non-experi 
designs 

Cost analysis 
Refer from: Audits 
Broader terms: Designs 

Cost benefit ratios 
' Broader term: Efficiency 

Costs' 
Use: Finances 



Co-therapy 
Use: Multiple counseling 

* Counseling 

Refer from: Assertiveness training. 
Crisis intervention. 
Guidance, Psychotherapy, 
Therapy, Vocational 
counseling - 
Narrower terms: Family counseling. 
Group counseling, 
Multiple counseling. 
Peer counseling 
Broader term: Intervention processes 

Counselor effectiveness 
Broader term: Effectiveness 
indicators 

Counselors ' 
Refer frbm: Lay counselors. Reha- 
bilitation counselorj^. 
Broader term: Serviqe personnel ^ * 

^Criminal justice projects 
Use: Legal services 
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Criminals 
Use: Offenders 



Crisis intervention 
Use: Counseling -.^^ V. 



.Criteria 

Use: Evaluation- criteria 



r crit^r 



Critical incidents technique 
Broader term:^ Systems analysis 

Cross valid^ition 
Use: Replication studies 

Culturally disadvantaged 
Use: Disadvantaged 

Data banks 
Narrower terms: Case files, Data 
tapes 

Broader term: Data collection 
Data coll ection 

/ Refer from: ' Collection, Self- 
reports 

Narrower terms: Data banks. Data, 
collection instru- 
ments. Data collec- 
tion strategies, 
Sampling techniques 

Broader term: Methodology 

Data collection instruments 
Refer from: Instruments, Measures r 
Narrower terms: Checklists, Forms, 

Questionnaires , 

Tests 

Broader term: Data collection 

Data collection strategies 
Narrower terms: Incentives, Mail 
surveys, Observa- 
tions, Personal 
interviews. Tele- 
phone interviews 
Broader term: Data collection 

Data processing equipment 
Refer from: Computers 
Broader term: Materials 



Data, processing personnel 
Broader term: Evaluative personnel 



Data tapes 
Broader term; 



Data banks 



Day care 
Refer from: Child care 
Broader term: Programs 



Deaf 
Use: 



Physically disabled 



Decision making 

Refer from: Pla-nning 

Narrower 'terms,: Program continua- 
tion, Program 
implementation, 
Program justifica- 
tion. Recommendations 

Broader term: Utilization 

Defenses / 
Broader term: Evaluation fears . 

Deficiencies 
Use: Resources 



Deficits 
Use: Finances 



Definitions ' 
Refer from: 'Weanings, .Operational 

* definitions. Terminology 
Broader term: Classification systems 

Delays 

Refer from: Undue delays' 
Broader term: Barriers 

Delinquency prevention program 
Use: Corrections 

Delinquents 
Use: Offenders 

Delivery systems 
Use: Services 

Demonstration 
Refer from: Pilot studies 
Broader term: Utilizatioji 
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Depr^essed areas 
Use: Geographical areas 

Descriptive statistics^ 
Broader term*: Statistical analysis 

Desensltlzation 
Use: Behavior modification 

Deslgnsy 
Refer frofn: Approaches, Models 
Narrower terms: Cost analysis, 
Experimental de- 
signs, Non experi- 
mental designs. 
Quasi experimental 
designs. System 
analysis 
Broader term: Methodology 

Developmental ly disabled 
Refer from: Epileptics, Mentally 
retarded 

Brpader term: Dysfunctional persons 

Diagnostics 
.Usb: Client assessment methods 

^Dialogue 

Usje: Communications 

I 

Dirept costs, 
Usis: Finances 

Direct observations 
Broader term: Observations 

Directors 
Broader term: Admin-istrative 
personnel 

Disabled 
Use: Physically disabled 

Disadvantaged ^ 
Refer from: Culturally disadvan- 
taged, Economically 
disadvantaged , 
Indigents^ Migrant 
workers, Poor 
Broader terms: Target populations 



Discontinuation 
Use: Program continuatton 

Dispositions * , , - 

Use: ^Attitudes ' ' 

Dissemination 
Broader term: Communications 

Districts • ' 

Use: Geographical areas , 

Division of Vocationa-l- Rehabilitation | 
Use: Vocational rehabilitation 
agencies 

Documents j [ 

Narrower terms \ Abstracts, Books, 
Handbooks, Journal 
articles, Mono- . I 
• graphs. Reports , ^ 
Broader term: Resul ts 

Drug education 
Use: Education 

Dysfunctional persons 

Narrower terms: Addicts, Alcoholics, 
Developmental ly 
disabled, Mentally, 
ill , Offenders, 
Physically disabled 

Broader term: Target populations 

t> 

Earnings 

, Refer from: Compensation, Income, 
Payment, Salaries, 
Wages 

Broader term: Indices 

li 

Economic indicators 

Narrower terms: Labor market con- 
ditions. Organized 
work force. Poverty, 
Stock market 

Broader term: /Conditiohs 

Economically disadvantaged 
Use: ' Disadvantaged 

Educability 
Use:. Abilities 



Education t 
Refer from: Adult education, Drug 
education, Instruction, 
Prograrmed instruction. 
Remedial education, 
Y Special education 
Broader term: Programs 

Educators 
Refer from: Faculty,^ Instructors, 

\ Teachers 
Broader term': Service personnel 

Effectiveness 
Use: Effectiveness indicators . 

Effectiveness indicators 
Refer from: Effectiveness, Effec- 
\ * tiveness ^studies. 

Success 

Marnower terms: Client satisfac- 
tion. Counselor 
effectiveness. 
Goal jattainment 

Broader term: Indicators 

Effectiverji^ss studies 
Use: Erfectiveness indicators # 

Effects 
U^e: ' Impl i cations 

Efficiency 
Use: Efficiency indicators 

Efficiency indicators 
Refer from: Efficiency, Efficiency 
studies 

Narrower terips: Cost benefit 

ratios, Effort, 
Evaluation length. 
Service length 

'Broader term: Indicators 

Efficiency studies 
Use: Efficiency indicators 

Effort 
Refer from: Energy 
Broader term: Efficiency indicators 



c Elderly 
Use: Aged 

Emotionally disturbed 
Use: Mentally ill . 

Empirical scaling 
Broader term: Scaling 

Employability 

Refer from: Job readiness. 

Vocational fitness. 
Readiness for work - 

Broader term: Status 

Employer attitudes ^ ^ 
Broader term: Personnel attitudes 

Employment 
Refer from: Unemployment 
Narrower terms: Attrition,. Job 

placement. Tenure 
Broader term^ Indices 

Energy . * 

Use: Effort 

Lnvironment ' ' 
' Narrower terms: Attitudes, Condi- 
tions, Needs, V 
' • Settings 

' Epileptics 

Use: Developmental ly disabled 

•'. ' 

Equipment 

/ Use: Materials' 
* 

Error detection 
Use: Validity 

Estimation 
Use: Measurement 

Ethical and legal constraints 
Refer from: Civil rights, Confi- 
dential ity. Ethics , 
Informed consent. 
Invasion of privacy. 
Legal , Rights 
Broader term: Values 
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Ethics 

Use: Ethical ahd legal constraints 

Ethnic groups 
Refer from: Asians, Blacks, 

Chicanos, Immigrants, 
Negroes, Orientals, 
Race 

Broader term: "Target populations 

Evaluation adequacy 

Refer from: Adequacy of evaluation 
' Broader, term: Utilization 

Evaluation criteria 
Refer from: Criteria 
Narrower ter^ms: Evaluation out- 
^ comes , Evaluation 

standards 
Broader term: Methodology 

Evaluation fears ' 
Refer from: Anxiety, Fearfeof 

evaluation ¥ 
Narrower terms: Defenses, 
Resistance 

Broader terms: Attitudes 

Evaluation length 
Refer from: Length of evaluation . 
Broader term: Effi-ciency indicators 



Evaluation methodology 
Use: Methodology 



/ 
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Evaluation needs 
Narrower terms: Priorities, Problem 

identification 
Broader term: Needs 

« 

Evaluation outcomes 
Refer fromi Hawthorne effects, 
^ Outcomes, Undesirable 

outcomes 

Broader term: Evaluation criteria 

Evaluation standards 
Refer, from^: Guidelines, Standards- 
Narrdwer terms: Case difficulty, 
J ^ Caseload size. 

Expectancy ratios > 
Norms, Staff to 
client ratios ' 
Evaluation criteria 




Evaluation strategies ^ 
Use: Methodology 

Evaluative personnel 
Narrower terms: 'Consultant 
processing, 
sonnel , Evaluators , 
Investigators, 
Pol icy analysts, 
^ReseiSrehers 
Broader term: ' Persofynel 

Evaluator attitudes 
Broader term: Personnel attitudes 

Evaluators 
Broader term*: Evaluative personnel 

Evaluee attitudes 
Broader term: Personnel attitudes 

Evaluees 

Use: Target populations * 



Evidence 
' Use: Results 

Examinations 
Use: Tests 



Expectancy ratios 
Broader term: Evaluation standards 

Expectations 
Broacler term: Goals 

Expenditures 
Use: Finances 

Experimental designs 
Refer from:. Experiments 
Broader term: Designs 

Experiments 
Use: Experimental designs 

Experts 
Use: Personnel 

Exploitation 
n Use: Utilization 




Broader term: 
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' Extinction ' / {'\ 
. ..Use; Behaj/ior modification / 

Extrinsic gain 
Use: Rehabilitation gain 

* Facilities 

Narro«Jrer terms: Centers, Clinics, 

' ^ Correctional 

V facilitiesi Halfway 

^ houses. Hospitals, 

, • R6habiVitation ; 
' facilities, Sefhools 
Broader t^rm: .Settings 

t Facility a^treditatipn * \, 
User, ?\ccrsditation 

F,dct0r analysis 
. Broader term: Mul tivariate 
: statistics 

f acul ty 

Use: Educators' , 

Family cpunseling 
Refer -From: Family planning 
Broader term: Counseling 

Family planning ; , - 

• Use:, Family x:ourrseling 

Fears of evaluation _ • 

Use: Evaluation fears 

Federal agencies 
Refer from: HEW, Social Security 
Broader /term: Agencies 

Federal grants ' , . ^ 
Use: Grants : ^ 

Federal legislation ^ 
Use:i -Legislation 

^Federal policies J 
Usier., Policies 

Feedback 
Broader term; Communications 



Field studies * 
Refer from; Site visits* 
Broader terra: Ndn experimental \; 
; / designs 

Films 

Use: AudiovisuaV. aids 

Finances ^ , 
Refer from: Appropriations, Costs, 
^ ^ Deficits, Direct costs , 
" Expenditures, Funding, 
- Indir^ect costi,' Money, 
Sub§,idies 
I^amower terjns: Budigel; .allocations, 
' Contracts, Grants, 
^ Loans ^ o 
Broader term: Resources 

findings ■ ' ; 

Use: Resul ts o.: * ; 

, Follow-up studies 

Broader term": Non experimental 
designs 

Forms , ' 

Broader term: Datai collection 
instruments 

Foster care 
Broader term: Program's . 

Funding ^ 
Use: Finances ^ 

• ' ♦? 

Gain ^ 
Use: Rehabilitation, gain 

Generalizations 
Use: Implications, 

Geographical* areas , 
Refer from*: Depressed areas, 

, Districts, Ghettos, 
^ Municipalities, Ruratj 

States, Urban 
.Breader term: Settings ' * 

Ghettos^ . ^ / 

Us^: Geographical areas 



Jpal attainment 

Broader term: Effectivenfess 
indicators 

. Goal ' attainment scaling 
Broader term: Seal ing 

' Goal setting ' * 
/ Broader term: Goals 



/ : 



Goals • 

Refer frojn: Objectives, Program 
^ goals, Purposes/ ; 

J Reasons - 
Narrower terms: Approach rationale, 
' . Expectations, Goal • 

y setting, Missipn, 

Motivation, . 

Philosophy a 

•1 ■ • /' 

Government information sources 
Broader term: Information centers 



^ni effei 
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Hawthorne effects 
Use; Eyal uBt ion Outcomes , 

Health care 
Refer from; Aftercare, Comprehen- 
sive health care. 
Patient -care 
^Narrower terms: Intensive care, 

. * Medicare, Methadone 

maintenance. Public^ 
. / ^ healthy Post- * 

hospital services 
Broader; term;/ Programs 

HEW 

'Use; Federal agencies 

High schools ^ 
Use: Schools ^ *^ . . 

Histograms ' ' 

Use: Audiovisual aids " 



Graduate Schools 
Use:% Schools 

Grad^jates 

" Use: 'students • ' \ 
Grant's 

Refer from; Federal grants^ 
^ ^: Stipends 
/ Broader teVm: Finances 

'. ^ / 
Graphs . . 

Use: Audiovisual aids 

Group counsel ing 
Broader term: Counsel.i ng 

Guidance • 

iUs.e: Counseling 

■ ■' ' .■ ' 
Guidelines * . . 

Use:* Evaluation standards 

Halfway; houses . 
Broader term: Facilities 

Handbooks 
Broader term:- Documents 



History ^ ^ . , 

Use: Literature reviews- ^ 

'' • ' ^ 

Hospitals^* 
Refer from; Mental hospitals. 

Nursing homes* 
By*oader term: Pacili^iies 

Human relations 
'Use: Interpersonal relations 

Hypnosis 
Broader fferm; ,, Intervention 
processes 

Illustrations 
Use: Audiovisual aids 

Irnni grants 
Use:^ Ethnic 'groups 

Impact 
Use: Utilization 
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Implications 
Refer from: Consequences, Effects, 
, Generalizations, 
■ Inferences 
Narrower terms: Politicalization, 
Prediction, Social 
. reform 
Broader term: Utilization 

In basket techniques 
Use: ' Management by objectives.. 

In service training v 
.Broader ternh: Training 



Incqjntives 
Refer from:, 



Broader term 



Monetary rewards. 
Praise, Punishment, 
Reinforcement, 
Rewards,' Tokens 

Data collection 

strategies . 



Incidence 
Refer from: Rates 
Broader term: Conditions 

Income 

, Use: / Earnings ' 

Indexing . 
Use: Classification systems 



Indicators . 
Narrower terms: 



^ Broader term: 

Indices 
Narrower terms 



Broader term: 



Effectiveness 
indicators, Effi- 

. ciency incji-icatorsy 
Performance indi- 
cators, Socjal ' 
indicators 

Results 



Benefits, Earn- 
ings, Employment, 

' Rehabilitation ^ 
gain. Status 

Results 



Indigents 
Use: Disadvantaged 



rndirect, costs 
^Use; Finances* 

Industrial relations 
Refer from: Organ izatioTia'l' 

relations 
Broader term: Relations 

id 

Infa'nts / 
Broader term; Youths 

Inferences 
Use: Implications 

Inferential statistics 
Broader term: Statistical 
analysis 



Information centers 
Refer from: Media 



Narrower terms 



Broader term: 



Clearing houses, 
Governmentyirifor- 
matiqn sources. 
Other information 
sourcesii / 
Information systems 



Information systems . 
Narrower terms: Bibliographies, ^ 
Classification i , 
systems. Informa- 
tion centers. 
Libraries , Litera-* 
ture reviews. Man- 
agement information 
systems 

Broader term: Resources 

Informed consent ' 
Use: Ethical and legal constraints ^ 

-Instruction 

Use: Education 

Instructors 
Use: Educators 

Instrumental conditioning 
Use: Behavior modification 

Instruments 
Use:' Data collection instruments 
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Intake 
Broader ternf: 



Status 



Intel! igerfce tests • ' 
\ Birbader €emi: Tests * v 

intensive care 
Broader term: Health care 

Interagency linkages 
Refer from: Agency relations, 

^ / Cooperat j on , Coopera- 
tive programs, Coor- 
, dination, Interag:gncy 
- ' / • relations. Linkage 

systems, Non vocational 
* \ rehabilitation agency 

relations. Vocational 
rehabilitation agency 
Velations, Vocatiohal 
rehabilitation and nop 
vocational .rehabilita- 
y ti^ agency relations' 

Broader term: /Relations 

Interagency reJ'ations 
Use: Interagency linkages 

* \ ' / 
Interests y • 

. Refer from: Preferences 

Broader, term: Needs 

Interest tests. 
Refer yfrom: Preference tests 
Broader term: / Tests 

Interpersonal relations 
. Refer from: Human relations • 
Broader term: Relations 



Interpretation 
Broader term: 



Results 



Intervention processes 
Refer from: Treatment 



tfarrower terms: 
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Broader term: 



Behavior modif ica- 
tion# Counseling, 
,Hypnosis, MiTieu 
therapy, Occupa- 
tional therapy. 
Psychotherapy, 
Rehabilitatron 

* Processes 

Services 



Intrusions , 
Broader term; Barriers 

Invasiorf of privacy • 
Use; Etfiical and legal constraints 

Inventories 

Use: Tests , , * ' 

■ . * 

Investigators 
Refer^om ; Aud i tors 
Broader term: Evaluative personnel 

« •« ■ 

Job performance 
Refer from:^ Work performance 
Broader term: Performance ^ 
/ / ' indicators ' 

- Jo6 placement 

Refer from: Placement 
Broader term: Employment 

Job readiness , . 

Use: Entptoyability 

Job training - ^ , 

Refer from :^ Vocational training 

Broader term: Training 

* . « ... 

Journal articles 
Broader term: 'Documents 

Judgments ' \ ^ 

Refer from : Mi sjudgments 
Broader term: Qualitative analysis 

* ■■ 

Juveniles / 
Use: Youths '■ - , 

Labor market conditions ^ 
Refer from: Lay offs : ^ 
Brdader term: Economic indicators 

Law enforcement agencies 
Broader term: Agencies 

Laws . * 

Use: Legislation 

Lay counselor's ' ' ' ^ 
Use: ' Counselors >^ 
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Lay off s 
Use: Labor market conditions 

Legal ' 

Use: Ethical and legal constraints 

Legal services 
Refer f.rom: Criminal justice 

. projpcts 
Broader tenm: Programs 

Legislatlpri 
Refer from: Acts, FederaUegisla- 
' tion, Laws, Mandates 

Broader term: Political attitudes 

Length of evalojation 
Use: Evaluation length 

Length of service 
Use: Service length 

Libraries 

X Broader term: Information systems 

Licenses * 
Use: Certification 

Linkage systems . 
' Use: Interagency linkages 

Literature reviews 
Refer from: History, State of the 
art 

Broader term: :{nformation systems 
Loans 

Broader term: Finances 

-LongHudinal studies 
' Broader term: Non experimental 
' ' designs 

' w 

Mail surveys 
Refer from: Surveys ^ 
Broader term: 'Data col-lection 
strategies 

Maladjustrtent 
Use: Change ' ^ . . 



Management assessment centers 
, Broader term: Centers 

Management attitudes 
Broader term: Personnel attitudes 

Management by objectives. 

Refer from: In basket tecbinfques 
' Bcoader term: Systems analysis 

Management ijiformation systems 
Broader term: Information systems 

Mandates 
Use: Legislation 

/• 

Manpower -agencies 
'Broader term: Agencies 

Matching 

Refer ifrom-: Paired sample 
Broader ter©: ' Sampling techniques 

■ * • " -I 

^Materials 

Refer'' from: Apparati , Equipment, 
Tools 

Narrower termS;: Audiovisual, aids, 
;Dati processing 
equipment, Physi- 
' cal plant. Tele- 
communications 

Broader term: Resources 

Meanings . 
Use: Defrnitions 

Measurement * 
Refer from:. Estimation 
Narrower terms: -CI ier|t< assessment 

- methods, Scaling 
Broader term: yMethodology 

Measures • 
Use: Data collection instruments 

Media 

Use: Information centers 

Medicare 

Broader term: Health care 
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Mental health centers 
Refer from:. SUfcide prevention 

center is / 
Broader term; Centers 

Mental hospitals ^ 
Use: -Hospitals 

Mentally iM. 
Refer from; ' Emotionally disturbed, . 

Neurotics, Psychotic s ^ 
' ' Broaderi 'term: Dysfunctional persons 

Mentally retarded ' 
Use: Developmental ly disabled 

Methadone maintenance 

Broader term: Health care 

Methodology 
Refer from: Activities, Evaluation ' 



methodology. Evalua- 
tion strategies, 
> / 'Methods, Procedures,, 
' Processes 
Narrower terms; Analyses » Data 
collection, 
Designs, Evaluation 
criteria. Measure- 
ment, Record keep- 
. ing procedures 

Methods 
Use: Methodology 

Middle aged 
Use: ' Older adults' 

Migrant workers 
Use: Disadvantaged 

Milieu therapy / 

Broader term: Intervention 
processes 

Military personnel 

Broader term: Target populations 

Mis judgments 
Use: Judgments 



•Wisslon ' 

Refer from; Mission statement 
Broader terra: Goals 

Mission statement , 
Use: ^lission 



Mobility 



training 



Refer from; Motor training 
Broader term: Training 

Model ingi ^ 
Use: pehavior modification 

Models 1 
Use: pjesign 

Modifications 
Use: Change - 

Monetary rewards , v 

Use: ilncentives 

Money 
Use: Finances 

Monographs 

Broader term: Documents 

Motivation 

Broader term: Goals 

Mo tbr training 
Use: Mobility training 

Multidimensional seal ing 
Broader term: Scaling 

Multiple counseling 
'Refer from: Co-therapy 
Broader term: Counseling 

Multiple regression 
Refer from: Regression ^ 
Broader term: Multivariate 
statistics 

Multiservice centers 
Broader term: Centers 
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Multivariate stc 
Narrower terms^ 



Broader term: 



istics 
Actuarial tech- 
niques, Automatic 
interaction 
ietector, factor 

lysis, Multiple 
retgression & 
tical analysis 



Municipalities 
Use: Geographical arc 

Narrative description 
Broader term: Qualjtati 



(e analysis 



Needs 
Narrower terms: 



Broader term: 



Comrpunity needs, 
Evaluation needs. 
Interests, 
Research needs 
Environment 



Negative attitudes 
Use: Attitudes 

Negroes 
Use: Ethnic groups 

Neurotics 
Use:^ Mentally ill 

Nomenclature 
Use: Classification systems 

Non experimental designs 
Narrower terms: Case studies, 
Correlational 
studies. Field 
studies. Follow 
up studies. Longi- 
tudinal studies. 
Simulations 
Designs 



Broader term: 



Non vocational rehabilitation agency 
relations 
Use: Interagency linkages 

Norms 

Refer from: Basel ine. data 
Broader term: Evaluation standards 



Nursling hojpes 
Use; Hcfspitals 

Objective tests 
Use^ Tests 

Objectives 
Use: Goals 

Objectivity 
Use; Bias 

Observations ' 
Refer from: Work samples . 
Narrower terms; Direct observa- 
tions. Participant 
observations. 
Unobtrusive 
observjations 
Broader : term: Data collection 
strategies 

Obstacles 
Use: Barriers 

Occupational therapy. , 
Broader terip: Intervention 
processes 

Occupational training facil ities 
Broader term: Rehabilitation 
facilities 

Offenders 
Refer from: Criminal, Delinquents 
Broader term: Dysfunctional 
persons 

Older adults | 
Refer from: Middle aged 
Broader term: Adults, 

On the job training 
Broader term: Training' 

Openmi ndedness 
Use: Bias 

Operant conditioning 
Use: Behavior modiftcation 
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Operational definitions 
Use: Definitions 

Operations research 
Broader term: Systems analysis 

Options' . 
Use: Recommendatidns 

Organizational analysis 
Use: Systems analysis 

Organizatidnal relations 
Usa; Industrial relations 

Organizational resistance 
Use: Resistance 

Organizations . 
Use: Settings 

Organized work force 
Refer from: Trade unions, Unions 
Broader term:* Econoijiic indicators 

Organizers 
Use: Coordinators 

Orientals 
Use: Ethnic groups 

Orientation 
Use: Training 

Other information sources 

Broader term: Information centers ' 

Other service resources 
Narrower terms: Ancillary services, 
Service duplication 
Broader term: Conditions 

Outcomes 

' .Use: Evaluation outcomes 

Paired sample ^. . . r^-^- 

Use: Matching ' 

Paraplegics 
Use: Physically disabled 



Pardle 

Use: Corrections / 

Participant observations 
Broader term: Observations 

Path analysis . 
' Broader term: Systems analysis . 

Patient, c^are 
Use: ^ealth care 

Payment 
Use: Earnings / 

Peer counseling 
Br'oader term: Counseling 

Performance 
Use: Performance indicators 

Performance indicators 

Refer from: Performance 

Narrower ^terms: Abilities, 

Achievement, Job 
performance. 
Ratings, Recidi- 
vism rates. Skill 
acquisition i Voca- 
tional adjustment 

Broader ter'm: Indicators • 

Performance tests 
Use: Tests 

Personal interviews 
Broader term^ Tests 

Personnel ^ 

Refer from: Experts 

Narrower terms: Administrative 

personnel , Evalua- 
tive per^sonnel , 
Service personnel 

Broader term: Resources* 

Personnel attitudes 
Narrower terms; Employer attitudes, 
» , Evaluator attitudes, 

Evaluee attitudes. 
Management attitudes 
Staff attitudes 
Broader term: Attitudes 
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Personnel reassignment 
. Broader tjerm; Program change. 

Philosophy . 
Broader term: Goals 

Physical plant 
Broader term: Materials 

Physically disabled 

Refer from: Amputees, Aphasics, 

Cardiacs, Blind, Deaf, 
Disabled, Paraplegics, 
Quadraplegics 

Broader term: Dysfunctional persons 

Pictorial tests' 
Use: Tests / 

Pilot studies 
Use: Demonstration 

Placement 

. Use: Job placement 

Placement specialists 
Broader term: Service personnel 

Planning 
Use: Decision making 

Policies 

Refer from: Federal policies. 
Public policies. 
Requirements, Rules, 
Social policies 

Broader term: Values 

Policy analysis 
•Broader term: Evaluative personnel 

Policy change 
Broader term: Change 

Political attitudes 
Narrower ter*ms: Community atti- 
tudes, Legislation 
Broader term: Attitudes 

^Political ization 

Broader term: Implications 



Poor 

Use: Disadvantaged 

Populations 
Use; Target populations 

Post employment services 
Broader term; Programs 

Post hospital services 
Broader term: Health care 

Poverty 

Broader term: Economic indicators 

Poverty programs 
Use: Social action programs 

Praise 
Use: Incentives ' 

Prediction 
Broader term: Implications 

Preference, tests 
Use: Interest tests 

Preferences 
Use: Interests - 

Prejudice ' 
, Use: Bias ^ 

Prevalence 
Broader term: Conditions 

Principles 
Use: Values 

Priorities 
Broader term: Evaluation needs 

Probability sampling 
Broader term: Sampling techniques 

Problem identification 
Refer from: Troubleshooting 
Broader term^ Evaluation needs 

Probl ems 
Use: Barriers 
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Procedures 
Use:" Methodology 

Processes ^ .■ ' 
Use: MetjBpdology 

Proficiency tests 
Use: Tests 

Program change 
Narrower terms: Personnel reassign- 
ment^ Relocation 
broader term: Change 

Program continuation 
Refer from: Discontinuation 
Broader term: Decision making 

Program evaluation rdview technique 
- Broader term: Systems analysis 

Program goals , ' 

Use: Gos^ls 

Program implementation , • 

Broader term: Decision inaking 

Program justification 
Refer from: Accountability 
Narrower terms: Accreditation, 
Certification 
**Broader terip: Decision making 

Program planning and budgeting system 
Broader term: Systems analysis 

Programmed instruction 
Use: Education , 

Programs 

Refer from: Projects 

Narrower terms :^ykomp^nsatory pro- 
grams. Corrections, 
Day care. Educa- 
tion,' Foster care. 
Health care, Leg^l 
services. Post : 
employment serv- 
•ices, Psychol ogi-^ 
cal testing,, Rec- 
reation, Social 
action programs, 
^ Training* Welfare 

• programs 



Projects 
Use; Programs 

Proof 
Use; Results' 

Psychoanalysis 
Use; Psychotherapy' 

. Psychol ogi pal testing 

Refer fromV Psychome tries 
Broader term: Programs i 

Psychome tries 
Use: . Psychological testing . 

Psychotherapy 
Refer; from: Psychoanalysis 
Broader term: Intervention 
processes 

Psychotics 
Use: Mentally ill 

Public health 
Broader term: Health care 

Public policies . 
Use: Policies * 

"■♦NT 

public relations 
Refer from; Advertisi^ig, Publicity 
Broader term: Relations 

Public welfare agencies 
Use: Welfare agencies 

Public welfare programs 
Use;, Welfare programs 

Publicity 
Use: Public relations 

' « 

Pun4shment 
Use: Incentives, 

Purposes - ' 

Use; Goals ^ 

Quadraplegics 
Use: Physically disabled 
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Qualitative analysis 
Narrower terms: Jiidgments, Narra- 
tive descriptions 
Broader term: Analyses 

Quantitative analysis . 
Use: Statistical analysis/ 

Quasi experimental designs 
^ Broader term: Designs 

Questionnaires • 
Broader term: Data collection 
instrumejits^ 

Race 

Use: Ethnic groups 

Racism 
Use: Bias 

Random sampling 
.Broader term:. Sampling tecl^niques 

Rapport . 
Use: Relations , ' 

» 

Rat6s 
Use: Incidence 

Ratings ^ 
Broader term: Performance 
indicators 

Rationale o^ approach ^ ^ 
Use: Approach rationale 

Readiness for work 
Use: Employabil ity 

Reasons 
Use: Goals 

Recidivism rates 
Broader .term: Performance 
indicators 

Recommendations 
Refer from: Advice, Options, 

Solutions 
Broader term: - Decision making 
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Record keeping procedures 
Broader; term : Me thodol ogy 

Recreation ^ 
Broader term: Programs 

Reexamination 
Use: Replication studies 

References 
Use: Bibliographies 

Referral / 
Broader term: Status 

Reform 
Use: Change 

Regression 
Use: Multiple regression 

Rehabilitation counselors 
. Use: Counselors 

Rehabilitation facilities 
'Narrower terms: Occupational 

training fa<|ili- 
ties,* Sheltered 
workshops 
Broader term: Facilities 

Rehabil itation gain 
Refer from: Gain 
Broader term: Indices 

Rehabilitation processes 
Refer from: Case maViagement, 

Casework; Vocational 
r^hatil itation 
Broader term: Intervention 
processes 

Reinforcement 
Use: Incentives 

Relations 
Refer from: Rapport 
Narrower terms: Industrial rela- 
tions'. Inter- 
agency linkages, 
Interpersonal 
relations. Public 
, relations 
Broader term: Conditions 
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Reliability 
Bmoader t^rm: 



Statistical analysis 



Relocation^ 
Broader term: Program change 

Remedial education 
Use: Education 

Replication studies 
Refer from: Cross validation, 
Reexamination ^ 
Broader term: Utilization 

Reports ' * 
'* Refer from: Technical reports 
Broader term .Documents 

Requirements 
Use: Policies 

Research needs 
Broader term: 'Needs 

Research utilization 
Use: Utilization > - 

Researchers 
< Refer from: Technologists 

Broader term: Evaluative personnel 



Resis^tance 
'Refer from: 



Organizational 
resistance 



Broader term: Evaluation fears 

Resources 
Refer from: Deficiencies, Sources 
Narrower terms: Finances, Informa- 
tion system^', , 
Materials, Per- 
sonnfil , Target 
populations 

Results 

Refer from: Conclusions, Evidence, 
Findings, Proof 

Narrower terms: Documents, Indica- 
tors, Indices, 
Ihterpreta.tion 



Rewards 
Use: Incentives 

Rights 

Use; Ethical and legal constraints 

Role playing 
Use; Simulations 

Rosenthal effect 
Use: Bias ' 



Rul es 
Use: 



Pol icies 



Rurail ' 
Use: Geographical areas, 

Salaries 
Use: Earnings 

Sampling techniques 

Narrower terms: Matching, Proba- . 

bility sampling, 
Random sampling, 
Stratffi'ed randon) 
sampling 

Broader term: Data collection^ 

Satisfaction 
Use: Client satisfaction 



Scaling 
Narrower terms 



Broader term: 



Attitude seal ing , 
Empirical scaling. 
Goal attainmd^nt ' 
scaling. Multi- 
dimensional 
scaling. Semantic 
different^ial 
Measurement . 



Schools 

Refer from: Colleges, Graduate 

schools. High schools, 
0 ni vers i ties 

Broader teirm: Facilities 

Self reports , /' 
Use: Data col'llection 
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'-Semantic differential 
Broader term: Scaltng 

Sensitivity training « 
Broader term: Training 

Service change 
Broader term: Change 

Service duplication * 
Broader term: Other service 
resources 

Service length 
Refer from: Length of service 
Broader term: Efficiency 
indicators 



Service personnel 
Narrower terms: 



Broader term! 

¥ 

Services 
Refer from 



Aides, Counselors, 
Educators, Place- 
ment specialists. 
Support staff 
Personnel . 



Community services, 
Sotial services 
Narrower terms: Intervention pro- 
cesses. Programs 
Broader term: Settings 



Settings 
Refer from: 



Context, Organiza- 
tions, Sites 



Narrower terms: Agencies^ Facili' 



Broader term: 



ties. Geographical 
areas. Services 
Environment . 



Severely disabled 
Refer from: Chronically ill , 
Broader term: Target populations 

Shaping 
Use: Behavior modification 

Sheltered workshops 
Refer from: Workshops 
Broader term Rehabilitation 
facil ities 



Simulations 
Refer from: Role playing^ 
Broa4er jiierm; N&n experimental 
designs 

Singer Grsrflex 
Use; Situational tests 

Site visits 
Use: Field studies 

Sites / 
Use: Settings 

Situational 'tests 
Refer from: Singer Graf lex. 

Tower system 
Broader term: Tests 

Situations 
Use: Conditions 

Skill acquisition - 
Broader term: Performance 
. indicators 

Social action programs 

Refer from: Action programs, Anti- 
poverty programs, Com- 
munity action programs. 
Poverty programs. Work 
incentive programs 

Broader term:. Programs 

Social adjustmerjt 
Use: Social indicators 

Socia]' indicators 
Refer from: Social adjustment 
Broader term: Indicators 

-* 

Social policies 
Use: Polici^es 

Social reform * 
Broader term; Implications 

Social Security ' 
Use: Federal, agencies 

Sdcial security Disability Incomfe 
Use: Welfare programs' 
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Socia> services 
Use: Services 

Social, welfare agencies 
Use: Welfare agencies 

Social welfare services 
Use: Welfare prograois 

socioeconomic status- 
Broader tertm: Status 

Sdlutions 
Use: Recomnendations 

Sources 
Use: Resources 

Special education 
U|e: Education 



Staff attitudes 
Broader term: 



Personnel .attitudes 



Staff to client ratios 
Broader term: Evaluation standards. 

Standards' 

*Use: Evaluation standards 

State agencies 
Use: Agencies 

State of the art 
Use: Literature review 

States ' \ ' 
Use: Geographical areas 

Statistical analysis * 
Refer from: Quantitative analysis- 
Narrower terms: Descriptive statis- 
tic^. Inferential 
statistics, Multi- 
variate statistics, 
Reliability. 
Validity 
Broader term: Analyses 



Status 

Narrower terms; Acceptance, Clo- 
sure, Employa- 
> bility, iTitake, 
Referral , Socio- 
economic status / 

Broader term^ Indices J 

Stipends 
Use: Grants 

Stock market 
Broader term: Economic indicators 

Stratified random sampling 
Broader term: Sampling techniques 

Students 

Refer from: College students, Gradu 

ates, Undergraduates 
Broader term: Target populations 

Subjects 
.Use: Target populations 

Subsidies 
Use: Finances 

Success 

Use: Effectiveness indicators 

Suicide prevention centers 
Use: Mental health centers 

Supervisors 
Broader term: Administrative 
personnel 

Support staff 
J^efer from: Technicians 
Broader term: Service personnel 

Surveys 
Use: .Mail surveys 
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Systems anji/ly sis ^ / V 

Refer f ronj : Organ i zatlona 1 ahalys i S 
viia terms; ^. CritiQa^^^ M]Q^ex0 

' . ■ . ' technique, Manatf^ 

/ ' " ; / ment by qbjectf 

; y ;^^^;;V dperations research^ 
/ ; vPath analysis^. Pro- 
' / gram evaluation 
■ '-t! • review ytecf\ni que > / 
Prografh planning ' 
and budgeting 
/: ; .; systeni * . 

Broader* terniir^besig^ 

Jabl es ; 

y^'Use: * Audiovisual aids 

Target populations 
Refer from: Evaluees,. Populations, 
Subjects 

Narrower terms: ^ Age groUps, Disad- 
vantaged, Dysfunc- . 
tional persons, 
: V- * \ Ethnic, groups, 

^ Military perisonnel , 
. Severely disabled, 
* ..Students, Unskilled 

workers 

Broader term: Resources 
Taxonomy 

Use: Classifieation^ systems V ^ , 

Teachers ; , 

Use: Educators / 

Technical reports 
Use: Reports 

Technicians 
Use: Support staff ^\ 

Technologists 
Use: Researchers 

Telecommunications v 
Broader term: MiSterials 

Tel ephone i n teryi ews 

Broader termr Data collection 
strategies 



Ternperament / • / /[ 

yvUs^: ' Attitudes 

Tenure^ 
Broad er term : Empl oyjneilt 

• ■> ■ ' ' ■ 

Terminology 

^ Use: Defini.t'fons ' 

/' - ' ' . 

Jests / . 
-J^efer from: Exa^ nations, Objec- 
\/ t iy| tes jts v Petjform- 

ance tests j^l^T<^ 
tests , Prpfieiency 
tests 

Narrower terms: Achievement tests. 
Aptitude tests , 
Intelligence tests, 
V Interest tests , 

Personality tests, 
. SituaJbional tests^ 

Broader term: Data collection < 
. - instruments ^ 

Theme ^ [ ' 

Use: Missipn' - ' 

Therapy ' . . ' . / 

Use: Counseling \ " 

Thesauruses / ' : ' 

Broader term: - Classification " . ^ 
systems - * 

Token economy . - " 

Usfe: Behavior modification^ 

Tokens 
Use: Incentives 



Tools 
Use: 



Materials 



Tower system 
Us^: Situational tests 

Trade unions 
Use: Organized wBrk force 



,;^aini>ng ^ , ^- 

Narrower' temis ; In service train- 
/ ' Ing, Job training, 

/ . Mobility training, 

• On the job train- ' 

ing, Orientation, 
/ ' Sensitivity 

training . 
Broader term: Programs 

Trfeatment 

Use: Intervention processes 

Troubleshooting ' . 

use: Problem identification 

Turnover 

Use;, Attrition \^ 

Typologies ; 
Use: Classification systems 

Undergraduates 
Use: Students 

Undesirable outcomes 

Use: Evaluation outcomes 

■to 

Undue^ deljdys . 
' Usfe: vDelc»ys 

Unemployment 
Use: Employment 

Unions 

Use: Organized workforce 

Universities 
Use: Schools 

Unobtrusive observations 
Broader term: Observations 

^ • 

Unskilled workers 

Broader term: Target populations 

Urban 

Use: Geographical areas 



' ^^Utilization 

Refer from: Exploitation, Impact, 
■ . y . ^ Research Utilization 
' Narrower terms; Change, Communi- 
cations, Decision- 
jnaking, Demonstra- 
. tions. Evaluation 
adequacy/Implica- 
tions, -Replication 
studies ^ ^ 

/ Validity ' 
-Refer from: Error detection 
Broader term: Statistical analysis 

Values 
Refer from: Principles 
Narrower terms: Ethical and legal 

constraints,' 

Policies 

^Broader term: Conditions 

Videotapes 
User Audiovisual aicls^ 

Visual aids . . 
Use: Audiovisual aids 

Vocational achievement 
* *Ose: Achievement 

Vocational adjustment 
Refer from: Work adjustment 
Broader term: Performance 
/ indicators 

Vocational counseling 
Use: Counseling 

Vocational fitness ^ 
Use; Employability 

Vocational rehabilitation 
' Use: Rehabilitation, process 

Vocational rehabil itation agencies 
Refer from; Division of Vocational 

Rehabil it^1;ion 
Broader term: Agencies 



Vocational rehabilitation and non ^ 
vocational rehabilitation agency 
•relations . * 
Use: Interagency linkages, 

Vocational, training 
Use: Job training . 

Wages . ' - 
Use: Earnings,. 

Welfare agencies 
Refer from Public welfare agen- - 

cieSi Social, welfare 
. \ - ' agencies 
Broader term: Agencies 

Welfare programs 

. Refer from:i AFDC, Public welfare 
* programs. Social 

^ Security Msability 
^ ! Income, Social welfare 
! services 
Broader term: Programs 

Work adjustment 
Use: Vocational adjustment 

Work incentive programs 
Use-: Social action programs 

Work performarlice 
Use: Job performance 

Work samples 
Use: Observations 

Workshops 
Use: Sheltered wo);;*kshops 

Voung adults 
Broader term: Adults 

Youths 
Refer from: Juvertiles 
Narrower term: Adolescents, 

Children, Infants 
Broader term: Age groups 



